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© An image processing technique is described in 
the context of a hierarchical image storage and re- 
trieval system. The method allows for the restriction 
of access to selected high resolution image compo- 
nents in the hierarchy from unauthorized use. The 
technique employs a key encryption of selected 
image components during storage, and decryption 
with a special key, or password during authorized 
retrieval. This technique allows users of a distributed 
system the convenience of providing the entire im- 
age hierarchy on a single storage medium. Access 
to the low resolution components is permitted with- 
out restriction for browsing and proofing. 
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Technical field Of The Invention 

The present invention is related to the field of 
digital image processing and more particularly to 
methods and associated apparatuses for preventing 
the unauthorized use of stored digital image com- 
ponents. 

Background Of The Invention 

An image hierarchy is constructed in the con- 
text of a multiresolution environment whereby the 
user has the option of selecting the type of display 
medium and the desired resolution of this display 
medium. In particular, two types of display media 
are considered: video monitors and color hard 
copies, through photographic, thermal imaging, and 
other types are also of interest. In Fig. 1 a prior art 
technique for decomposing, storing, recomposing, 
and displaying, a digital image using a hierarchical 
process is shown. An original digital image is de- 
composed to provide image versions at various 
resolutions to allow for the display of an HDTV 
quality image on video, an NTSC quality image 
with PAL7SECAM compatibility on video, one or 
more sub-NTSC quality images on video for over- 
views and browsing, and a very high quality image 
on color hard copy. Intermediate the decomposition 
and recomposition steps, generally are inserted an 
encoding step, to compress the data for storage 
which in turn requires a decoding step prior to 
further usage. 

The present invention uses encryption of se- 
lected image components of the image hierarchy to 
prevent use of the selected components for the 
generation of unauthorized high quality color hard 
copy. Encryption is a form of scrambling of the 
digital data to prevent use of the data by an un- 
authorized receiver of the data. In a distributed 
image system it is common to deliver an image of 
compromised image quality for purposes of brows- 
ing or proofing. A compromised rendition of the 
image is commonly distributed to prevent full utility 
or fulfillment of the image without proper consider- 
ation for the service that generated the image. The 
term browsing refers to the process of image se- 
lection from a plurality of images based on some 
user-defined criterion. Such is the case when a 
user may select an image from a catalog of images 
depicting a particular object. . The term proofing 
refers to the process of image selection based on 
the degree of desirability of a given image from a 
plurality of images. Such is the case when a pro- 
fessional portrait photographer distributes a plural- 
ity of images to the client for selection and ap- 
proval. The terms browsing and proofing described 
herein are not limited to the examples described 
above. 



It is desirable for the person performing a 
photographic service, most often a professional 
photographer or service bureau, herein after re- 
ferred to as the professional, to release a com- 
5 promised rendition of the image to the client for 
browsing or proofing. A compromised rendition of 
the proof is given to the client to prevent the client 
from obtaining a high quality copy of the proof 
through other means, without paying the photogra- 
10 pher or service bureau a premium for such service. 
Upon selection of the desired image by the client, 
the professional delivers a high quality rendition of 
the image, most often in the form of a high quality 
color hard copy. At all times the professional pos- 
15 sesses the sole means of generating the high qual- 
ity hard copy. In a conventional photographic sys- 
tem the means would be the original negatives of 
the images; in a digital hierarchical system accord- 
ing to the present invention, the means are higher 

20 resolution residual components. 

In a digital imaging system, and in particular 
one that includes a hierarchical form of digital 
storage and retrieval, the professional may use a 
suitable digital storage medium for the distribution 

25 of proofs. In an unrestricted environment, the client 
may choose a desired image resolution from the 
hierarchy for the purposes of browsing, proofing, or 
hard copy fulfillment. It is desirable for the profes- 
sional to deliver the digital storage medium con- 

30 taining the entire image hierarchy to the client; it is 
also most economical to record the entire image 
hierarchy once onto the digital storage medium and 
avoid having to make a second copy containing 
only low resolution components for distribution. 

35 However, it is desirable to the professional to re- 
strict the use of selected high resolution compo- 
nents for the purpose of full image quality fulfill- 
ment. Note that fulfillment may mean high quality 
video at NTSC/PAL'SECAM. HDTV, or hard copy. 

40 The client, having possession of the digital storage 
medium would possess the means for generating 
his/her own high quality hard copy through au- 
thorization from the professional. Upon consider- 
ation to the professional, the professional would 

45 provide the information necessary for full image 
quality fulfillment. In the present invention that in- 
formation would be an authorization code. key. or 
password that would be input to the image pro- 
cessing system, to unlock the restricted high reso- 

50 lution .components. An advantage of this technique 
is that the client may possess all information per- 
tinent to generating high quality hard copy without 
the need to physically return to the professional for 
additional image components. 

55 It is additionally desirable to use some form of 

image hierarchical structure of the image for the 
purpose of browsing or proofing in a distributed 
system because the hierarchy naturally provides a 
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plurality of resolutions, and hence levels of image 
quality, from which to choose the proof image. No 
additional operation of compromising the image is 
necessary; the professional simply chooses at what 
resolution level(s) he wants to restrict access. 

Systems that use a hierarchical structuring of 
the image data have not been employed in the 
past for distribution purposes because of the lack 
of means to simultaneously provide low resolution 
components for browsing and proofing, while offer- 
ing restricted access to the remaining hierarchical 
components for full quality image copy. 

A number of hierarchical techniques for image 
coding have been described in the open technical 
literature and in various patents. Of particular rel- 
evance to the present invention are the following 
publications: 

P. J. Burt and E. H. Adelson, "The Laplacian 
Pyramid As A Compact Code," IEEE Trans. 
Comm., COM-31. 532-540 (1983). 

W. Ford and B. O'Higgins, "Public-Key Cryp- 
tography And Open Systems Interconnection," 
IEEE Comm. Mag. 30-34, July 1992. 

G. Brassard. "Modern Cryptology: A Tutorial," 
Lecture Notes In Computer Science 325, Springer- 
Verlag, 1988. 

C. H. Meyer and S. M. Matyas, "Cryptography: 
A New Dimension In Computer Data Security," J. 
Wiley & Sons, 1982. and the following patents: 

U.S. Pat No, 4,969,204 entitled "Hybrid Resid- 
ual-Based Hierarchical Storage And Display Meth- 
od For High Resolution Digital Images In A Mul- 
tiuse Environment," by Paul W. Melnychuck and 
Paul W. Jones, 1990. 

U.S. Pat No, 5,048,111 entitled "Hybrid Sub- 
band-Based Hierarchical Storage And Display 
Method For High Resolution Digital Images In A 
Multiuse Environment," by Paul W. Jones and Paul 
W. Melnychuck, 1991. 

The publication by Burt, et. al. teaches an enr 
coding method for images termed the Laplacian 
pyramid, the Burt pyramid, or the residual pyramid. 
In this technique, the original image is lowpass 
filtered, and this lowpass image is subsampled to 
take advantage of its reduced bandwidth to provide 
an image of reduced dimension. This process of 
lowpass filtering and subsampling is repeated three 
times to generate a hierarchical structure, or pyr- 
amid of images of successively smaller dimen- 
sions. The total number of resolution levels are 
created depending on the application. Each 
lowpass image in this pyramid is then expanded to 
the dimensions of the next higher level by upsam- 
pling (inserting zeros) and filtering to form a predic- 
tion image for that level. This prediction image is 
subtracted from its corresponding lowpass image 
in a subtractor to generate difference, or residual, 
images. The residual images corresponding to the 



levels of the lowpass pyramid form another pyr- 
amid which is termed the Laplacian, Burt, or resid- 
ual pyramid. This technique is motivated by the 
fact that the residual images have a reduced vari- 
5 ance and entropy compared to the original or 
lowpass images and may be quantized and entropy 
encoded to provide efficient storage of the data. 
Reconstruction is performed by interpolating the 
decoded lowpass image at the bottom of the 

io lowpass pyramid and adding in the corresponding 
decoded residual to generate the next level in the 
lowpass pyramid. This process is iterated until the 
original image size is reached. A progressive im- 
provement in reconstructed image quality and res- 

75 olution can thus be obtained by displaying the 
reconstructed lowpass filtered image at each level 
of the pyramid. Note that errors introduced in the 
encoding process are propagated from one level to 
the next higher level in the decoding process. 

20 The patent to Melnychuck and Jones (U. S. 

Pat. No. 4,969,204) teaches a modification of the 
Burt pyramid scheme by extending the lowpass 
pyramid structure to include one or more lowpass 
filtered images of successively smaller dimensions 

25 beyond the set described by Burt, et al. The ad- 
vancement in the method of Melnychuck and 
Jones is that the residual pyramid is not extended 
to include these corresponding extended smaller 
dimensions. Hence, the Melnychuck and Jones 

30 pyramid contains the Burt pyramid plus additional 
lowpass filtered images of smaller dimensions. In a 
hierarchical image storage and retrieval system, 
the additional lowpass filtered images of smaller 
dimension can be retrieved directly, without inter- 

35 polation and addition of residual components. In 
the context of the present invention, the Mel- 
nychuck and Jones pyramid provides for low reso- 
lution images that can be used for browsing or 
proofing. The use of these additional low resolution 

40 images for browsing and proofing means that the 
client may use a simple retrieval mechanism and 
need not possess a more complex and hence, 
more expensive retrieval device that would be used 
to decode the higher resolution components of the 

45 pyramid. Of course, higher resolution images re- 
quiring interpolation and residual addition may be 
used for browsing and proofing as well. 

The patent to Jones and Melnychuck (U. S. 
Pat. No. 5.048,111) teaches a hierarchical storage 

so and retrieval method based on subband decompo- 
sition. 

The prior art in the open technical literature 
cited earlier contains several methods of encryption 
that may be applied to one or more of the high 
55 resolution residual components. Generally there ex- 
ists two broad methods of encryption that are rel- 
evant to the present invention: symmetric and pub- 
lic-key. Both encrypt the data using computer al- 
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gorithms, and provide users' restriction through the 
use of passwords or keys. The difference between 
the two techniques lies in the way the keys are 
used. 

A symmetric encryption system has a single 
key, which is used to both encrypt and decrypt the 
data. The algorithm is a mathematical process that 
transforms the data into some form of scrambled 
cipher data and back again, with the transformation 
depending on the value of the key. This system is 
adequate for a small number of communicating 
parties. However, it may become impractical to 
share the key knowledge and maintain secrecy as 
the number of communicating parties grow. 

For a larger number of communicating parties 
a public-key encryption process may be more ap- 
propriate. This type of system uses complementary 
pairs of keys to separate the functions of encryp- 
tion and decryption. One key in a pair, the private 
key is kept secret to the originator, just as in the 
symmetric encryption system; but the other key is 
made public. This is not a drawback, because even 
if the public key is known, it is not possible to 
determine the private key. This two-key approach 
greatly simplifies key management by eliminating 
the need to manage and store astronomical num- 
bers of keys, and by enabling keys to be distrib- 
uted via unrestricted systems such as public dis- 
tribution systems. 

The present invention combines the Mel- 
nychuck and Jones pyramid structure with prior art 
encryption methods, to provide a combined hierar- 
chical image storage and retrieval system with en- 
cryption of selected high resolution residual com- 
ponents. 

Summary Of The Invention 

In one embodiment of the invention there is 
provided a storage medium having stored therein 
at least one low resolution digital image and at 
least one high resolution digital image, with said 
low resolution digital image being accessible with- 
out the use of a key and with said high resolution 
digital image being accessible only with a key. 

In another embodiment of the invention there is 
provided a method for controlling the access to a 
digital image stored on a storage medium in a 
hierarchical form comprised of a BASE image and 
at least one residual image component, comprising 
the steps of: 

a) encrypting said at least one residual image 
component with a code key; 

b) permitting access to the BASE image for low 
resolution viewing of the digital image; 

c) controllably providing a decode key to an 
authorized viewer to enable accessing of the at 
least one residual image component; and 
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d) combining the BASE image with the at least 
one residual component to form the digital im- 
age for viewing, printing and/or storing. 
In yet another embodiment of the invention 
s there is provided a system for controlling the re- 
construction of a high resolution digital image 
stored on a storage medium as BASE and residual 
components, comprising: 

means for encrypting the residual components 
70 stored on said storage medium using a code key; 

means for accessing the BASE and encrypted 
residual components; 

means requiring the code key to decrypt the 
encrypted residual components; and 
75 means for combining the accessed BASE and 

decrypted residual components to reconstruct the 
high resolution digital image. 

The present invention uses the advantages of 
hierarchical image decomposition to create a series 
20 of residual components and low resolution images. 
The low resolution images are viewable without 
constraint, but the reconstruction of higher resolu- 
tion images is controlled by requiring that a user 
know a key code, generally provided by the en- 
25 cryptor, that controls access to the residual compo- 
nents that must be combined with selected low 
resolution image to produce the higher resolution 
images. 

From the foregoing, it can be seen that it is a 

30 primary object of the present invention to provide a 
method and associated apparatus for storing and 
controllably retrieving digital images stored in a 
hierarchical format on a suitable digital storage 
distribution medium that allows the originator of the 

35 distribution medium to distribute the medium con- 
taining the entire image hierarchy for the purpose 
of retrieving low resolution images for browsing or 
proofing without compromising the originator's 
need to withhold the means to create full image 

40 quality hard copies. 

It is another object of the present invention to 
provide low resolution images, for browsing or 
proofing, in a form that allows for direct retrieval 
and display, without the need for additional recom- 

45 position steps as is required for high resolution 
residual components while controlling access to the 
high resolution residual components. 

It is another object of the present invention to 
provide the means for controlling access to high 

so resolution residual components stored in a storage 
media. 

It is another object of the present invention to 
provide a storage media having stored therein one 
or more digital images, stored in a hierarchical 
55 format along with a control key that controls the 
users access to one or more of the hierarchical 
formats of the digital images. 
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The above and other objects of the present 
invention will become more apparent when taken in 
conjunction with the following description and draw- 
ings wherein like characters indicate like parts and 
which drawings form a part of the present descrip- 
tion. 

Brief Description Of The Drawings 

Fig. 1 is a block diagram illustrating the prior 
art Melnychuck and Jones hierarchical storage and 
display method. 

Fig. 2 is a block diagram illustrating a hierarchi- 
cal image decomposition system incorporating key 
encryption for selected image components. 

Fig. 3 is a block diagram illustrating a re- 
construction system for reconstructing the images 
decomposed by the system of Fig. 2. 

Fig. 4 is a detailed block diagram of the de- 
composition apparatus 100, shown in Figure 2 de- 
composition method. 

Fig. 5 is a detailed block diagram of the re- 
construction apparatus 200, shown in Figure 3. 

Fig. 6 is a detailed block diagram of the en- 
cryption portion of the system of Figure 2. 

Fig. 7 is a detailed block diagram of the de- 
cryption portion of the system of Figure 3. 

Description Of The Preferred Embodiments 

In the following description of the preferred 
embodiments, it will be assumed that the highest 
resolution of the image hierarchy is composed of 
3072 x 2048 pixels and that this resolution is ade- 
quate to produce photographic quality originals on 
an appropriate digital output device. It is also as- 
sumed that a moderately high resolution level of 
the hierarchy composed of 1536 x 1024 pixels is 
adequate to generate a high quality HDTV display, 
or a small-sized photographic quality, print on an 
appropriate digital output device. It is also assumed 
that the lowest resolution levels of 192 x 128 pixels, 
384 x 256 pixels, and 768 x 512 pixels are gen- 
erated and stored directly onto a digital storage 
medium according to the Melnychuck and Jones 
pyramid structure and that these resolutions are 
adequate for image browsing and proofing. These 
resolution levels are provided to give the reader an 
insight as to the operation of one or more embodi- 
ments of the invention with the understanding that 
other resolutions or arrangements may be chosen 
to suit specific needs without detracting from the 
teachings of the present invention. 

Referring now to Fig. 2, a hierarchical residual 
decomposition technique, for decomposing a 
16BASE original image to from a, 16BASE residual, 
4BASE residual, BASE, BASE/4, and BASE/16, im- 
ages, incorporating the teachings found in Fig. 1 of 



the patent to Melnychuck and Jones (U. S. Pat. No. 
4,969,204), is shown outside of the outlined box 20. 
The encoded 16BASE residual image (component) 
is passed through a key encriptor 22 controlled by 

5 a key 24. In the preferred embodiment of the 
invention the key should contain a sufficient num- 
ber of numbers, symbols and/or letters to make 
trying all of the possible combinations restrictive. 
The output from encryptor 22 is an encrypted 

10 16BASE compressed residual image that is stor- 
able on a storage medium, such as a CD disk. In a 
like manner, the 4BASE residual image is encoded 
and forwarded to a symmetric key encryptor 26 
that is controlled by the key 28. Symmetric key 

15 encryptors 22 and 26 may be identical in construc- 
tion, but this is not required. In a like manner, keys 
24 and 28 may be identical, but this also is not 
required. The encrypted 4BASE residual image is 
likewise stored on the storage medium. The BASE, 

20 BASE/4, and BASE/16 images are formed by low 
pass filtering and subsampling the BASE image 
and the BASE/4 image and also stored on the 
storage medium. 

A reconstruction technique that can be used to 

25 recompose the images decomposed by the tech- 
nique of Fig. 2 and stored on the storage medium 
is disclosed in Fig. 3. The BASE/16, and BASE/4 
images may be retrieved from the digital storage 
medium and made available for use such as a 

30 viewing on a display device 300. To be noted is 
that these images were not encoded prior to stor- 
age on the storage medium, therefore they do not 
have to be decoded prior to being sent to the 
display device 300. In a proofing mode these im- 

35 ages can be viewed by the customer at home 
using a CD player, without knowledge of the key 
code. A reconstruction apparatus 200, illustrated in 
Fig. 2 of the patent to Melnychuck and Jones (U. 
S. Pat. No. 4,969.204) is used to form, from the 

40 BASE image accessed, from the storage, medium a 
prediction image that is combined with a decoded 
4BASE residual, also retrieved from the storage 
medium, to form a recomposed 4BASE image. The 
recomposed 4BASE image may then be displayed 

45 on the display device 300 or it may be further 
processed if the higher resolution 16BASE image is 
desired. If such is the case, the reconstructed 
4 BASE image is subjected once more to a re- 
construction apparatus 201 to form a prediction 

so imagf . that is combined with a decoded 16BASE 
residual image, retrieved from the digital storage 
medium, to form the recomposed 16BASE image. 
The previous discussion assumed that the encoded 
4 BASE residual image and/or the encoded 16BASE 

55 residual image were readable from the recording 
medium due to the correct keys 34 and 38 being 
applied to the associated symmetric-key decryp- 
tors 32 and 36. If the correct key combination were 
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not applied these encoded residual images would 
not be available thereby preventing the reconstruc- 
tion of the 4 BASE and/or the 16BASE images. 
Although a display device 300 is shown receiving 
the higher resolution images it is to be understood s 
that a hard copy may be desired. Such being the 
case a printer capable of printing high resolution 
images would also receive the 4 BASE and/or 
16BASE images. Although a display device 300 is 
shown receiving the higher resolution images it is 10 
to be understood that a hard copy may be desired. 
Such being the case, a printer capable of printing 
high resolution images would also receive the 
4BASE and/or 16BASE images. 

Fig. 4 illustrates the structural arrangement of 75 
the decomposition apparatus 100 of Fig. 2. The 
16BASE image is low pass filtered in LPF 40 and 
delayed in delay 46. The lowpass filtered image is 
subsampled to take advantage of its reduced band- 
width to provide the 4BASE image that is forwar- 20 
ded to the decomposition apparatus 101, which 
may be identical in construction to decomposition 
apparatus 100. The lowpass image is upsampled in 
44 to expand it to the dimensions of the next 
higher level (in this case the 16BASE original im- 25 
age by inserting zeros) and interpolation filtered in 
48 to form a prediction image. The prediction im- 
age is subtracted from its corresponding original 
image in subtracter 49 to provide a difference, or 
residual image. The residual image is then option- 30 
ally compressed in an encoder to save storage 
space and forwarded to the key encryptor 20. 

In Fig. 5 the key decrypted residual image 
from decryptor 30 is decoded (decompressed) if it 
was compressed during the storage process and 35 
combined in the summer 56 with the BASE image 
that has also been accessed from the storage 
medium. Prior to being combined the BASE image 
is upsampled in 52 and passed through an inter- 
polation filter 54 to form a prediction image repre- 40 
senting the 4BASE image. The combination pro- 
vides the 4BASE image which is then forwarded to 
the reconstruction apparatus 201 which may be 
identical to the reconstruction apparatus 200, for 
generation of the 16BASE original image. 45 

Fig. 6 illustrates the details of one type of key 
encryptor that may be used to encrypt the residual 
image. The huff man encoded residual data is di- 
rected to the input of a residual buffer 60. The 
encryption key 24 is forwarded to an encryption so 
key buffer 62. The outputs of buffers 60 and 62 are 
combined in a logical XOR circuit 64 and directed 
to an encrypted residual buffer 66 for temporary 
storage until ready for storage in the storage me- 
dium. Key encryptor 26 may be identical to key 55 
encryptor 22. 

Fig. 7 illustrates the details of one type of key 
decryptor 32 that may be used to decrypt the 



encrypted residual image accessed from the stor- 
age medium. The accessed encrypted residual 
data is directed to a residual buffer 70 while the 
encryption key is directed to an encryption key 
buffer 72. The outputs from buffers 70 and 72 are 
logically XOR'ed in 74 and forwarded to a decryp- 
tion residual buffer 76 for temporary storage until 
ready for recombination with one of the predicted 
higher resolution images. 

While there has been shown what are consid- 
ered to be the preferred embodiments of the inven- 
tion, it will be manifest that many changes and 
modifications may be made therein without depart- 
ing from the essential spirit of the invention. It is 
intended, therefore, in the annexed claims, to cover 
all such changes and modifications as may fall 
within the scope of the invention. 
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1. A storage medium having stored therein at 
least one low resolution digital image and at 
least one high resolution digital image, with 
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said low resolution digital image being acces- 
sible without the use of a key and with said 
high resolution digital image being accessible 
only with a key. 

2. The storage medium according to claim 1 
wherein said at least one high resolution digital 
image is encrypted and the key permits de- 
cryption of said at least one high resolution 
digital image. 

3. A storage medium having stored therein at 
least one low resolution digital image and at 
least one high resolution digital image in the 
form of a BASE image and residual image 
components, with said low resolution digital 
image and said BASE image being accessible 
without the use of a key and with said high 
resolution digital image being accessible only 
by combining the BASE image with said resid- 
ual image components under control of the 
key. 

4. The storage medium according to claim 3 
wherein the key controls access to one or 
more of the residual image components. 

5. A system for controlling the reconstruction of a 
high resolution digital image stored on a stor- 
age medium as BASE and residual compo- 
nents, comprising: 

means for encrypting the residual compo- 
nents stored on said storage medium using a 
code key; 

means for accessing the BASE and en- 
crypted residual components; 

means requiring the code key to decrypt 
the encrypted residual components; and 

means for combining the accessed BASE 
and decrypted residual components to recon- 
struct the high resolution digital image. 

6. A system for encrypting and decrypting a high 
resolution digital image comprising: 

means for forming a hierarchy of lower 
resolution digital images from the high resolu- 
tion digital image; 

means for forming residual images that are 
a function of differences between adjacent im- 
ages in the hierarchy of lower resolution digital 
images; 

encryption means for encrypting at least 
one of the formed residual images; 

storage means for storing the formed hier- 
archy of lower resolution images and the at 
least one encrypted residual images; 

means for reconstructing high resolution 
images by accessing and combining a lower 



resolution image with a residual image; 

means for controlling the decryption of the 
at least one encrypted residual image to in 
turn control the reconstruction of the high reso- 
5 lution image. 

7. A recording medium having stored thereon a 
plurality of digital images with each of the 
digital images being comprised of low resolu- 

w tion digital image components and key encryp- 

ted residual digital image components which 
are combinable with low resolution digital im- 
age components to form a higher resolution 
digital image when accessed with a decryption 

75 key. 

8. A method for controlling the access to a digital 
image stored on a storage medium in a hierar- 
chical form comprised of a BASE image and at 

20 least one residual image component, compris- 

ing the steps of: 

a) encrypting said at least one residual im- 
age component with a code key; 

b) permitting access to the BASE image for 
25 low resolution viewing of the digital image; 

c) controllably providing a decode key to an 
authorized viewer to enable accessing of 
the at least one residual image component; 
and 

30 d) combining the BASE image with the at 

least one residual component to form the 
digital image for viewing, printing and/or 
storing. 

35 9. A hierarchical image storage and encryption 
method comprising the steps of: 

(a) forming a digital representation of an 
image; 

(b) decomposing said digital representation 
40 according to the. following steps; 

i. lowpass filtering and subsampling said 
digital representation to form a lower res- 
olution image; 

ii. interpolating said lower resolution im- 
45 age to the dimensions of the digital re- 
presentation to form a prediction image; 

iii. subtracting said prediction image from 
the digital representation to form a resid- 
ual image; 

so iv. key encoding and storing s^id resid- 

ual image; and 

v. creating a plurality of key encoded, 
and stored residual images of different 
resolutions by iterating steps i, ii, iii, and 
55 iv where the input to the lowpass filtering 

and subsampling operation of step i is 
the lower resolution image formed in the 
previous iteration step i and storing at 
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least one of the formed lower resolution 
images. 



11. A hierarchical image storage and encryption 
method comprising the steps of: 

(a) forming a digital representation of an 
image; 

(b) decomposing said digital representation 
according to the following steps: 

i. filtering and subsampling said digital 
representation to form a lower resolution 
image of said digital representation; 

ii. forming a prediction image of said 
digital representation from said lower res- 
olution image; 

iii. subtracting said prediction image from 
said digital representation to form a re- 
sidual image; 

iv. key encrypting, and storing said resid- 
ual image; and 

v. creating a plurality of key encrypted 
and stored residual images of different 
resolutions by iterating steps i, ii, iii, and 
iv where the input to the operation of 
step i is the lower resolution image 
formed in the previous iteration step i 
and wherein each lower resolution image 
is stored; and 

vi . controlling the formation of a higher 
resolution image by requiring the use of 
a key decry ptor for accessing the stored 
residual images. 

12. A hierarchical retrieval and decryption method 
according to claim 11 wherein step vi is com- 
prised of the steps of: 

a) retrieving at least one of said key encryp- 
ted and stored residual images and one of 
said tower resolution images; 

b) decrypting said at least one of the re- 
trieved key encrypted residual images; and 



c) combining the decrypted residual image 
with said at least one lower resolution image 
to form a higher resolution image. 

U A hierarchical retrieval and decryption method 
according to claim 12 and further comprising 
the steps of: 

a) interpolating said at least one lower reso- 
lution image to the dimensions of the next 
higher resolution level image to form a pre- 
diction image; 

b) retrieving and decrypting with an encryp- 
tion key the residual image corresponding 
to said next higher resolution level image; 
and 

c) adding the decrypted residual image to 
said prediction image to form a higher reso- 
lution image for further use. 

20 14. A hierarchical storage and encryption method 
comprising the steps of: 

(a) forming a digital representation of an 
image; 

(b) decomposing said digital representation 
25 according to the following steps: 

1 . lowpass filtering and subsampling said 
digital representation to form a lower res- 
olution image; 

2. interpolating said lower resolution im- 
30 age to the dimensions of the higher reso- 
lution image to form a prediction image; 

3. subtracting said prediction image from 
the higher resolution image to form a 
residual image; 

35 4. compressing, and storing said residual 

image; 

5. creating a second residual image by 
iterating steps 1, 2, and 3 where the 
input to the lowpass filtering and sub- 

40 sampled operation of step 1 is the lower 

resolution image formed in the previous 
iteration step 1 ; 

6. key encrypting, compressing and stor- 
ing said second residual image; and 

45 7. creating a plurality of key encrypted, 

compressed, and stored residual images 
of different resolutions by iterating steps 
1, 2, 3, and 4 where the input to the 
lowpass filtering and subsampling opera- 

50 A tion of step >I l is the lower resolution 

image formed in the previous iteration 
step 1 . 

15. A method for reforming the digital representa- 
55 tion of an image stored and encrypted accord- 

ing to the method of claim 14 compressing the 
steps of: 



10. A method for reforming the digital image re- 
presentations encrypted according to the 5 
method of claim 9. 

A) accessing and interpolating at least one 
of the formed and stored lower resolution 
images to the dimensions of a next higher 
resolution level to form a prediction image; io 

B) retrieving and key decoding at least one 
of said stored key encoded residual images; 

C) adding said key decoded residual image 
to said prediction image to form a higher 
resolution image for further use; and 75 

D) iterating steps A through C for each user 
selected remaining residual image of step 
(b.iv). 
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1. interpolating a retrieved lower resolution 
image to the dimensions of the next higher 
resolution level image to form a prediction 
image; 

2. retrieving and decrypting with a key, the 5 
residual image corresponding to said next 
higher resolution level; 

3. adding decryptor residual image to said 
prediction image to form a higher resolution 
image for further use; io 

4. iterating steps 1-3 for each remaining 
residual image of step (b). 

16. A hierarchical storage and encryption method 

comprising the steps of: *s 

(a) forming a digital representation of an 
image; 

(b) decomposing said digital representation 
according to the following steps: 

1. lowpass filtering and subsampling said 20 
digital representation to form a lower res- 
olution image; 

2. interpolating or replicating said lower 
resolution image to the dimensions of the 
higher resolution image to form a predic- 25 
tion image; 

3. subtracting said prediction image from 
the higher resolution image to form a 
residual image; 

4. key encrypting, compressing and stor- 30 
ing said residual image; and 

5. creating a second residual image by 
iterating steps 1. 2, and 3 where the 
input to the lowpass filtering and sub- 
sampled operation of step 1 is the lower 35 
resolution image formed in the previous 
iteration step 1 ; 

6. key encrypting, compressing and stor- 
ing said residual image; and 

7. creating a plurality of key encrypted, ao. 
compressed and stored residual images 

of different resolutions by iterating steps 
1, 2, 3, and 4 where the input to the 
lowpass filtering and subsampling opera- 
tion of step 1 is the lower resolution 45 
image formed in the previous iteration 
step 1 ; 

(c) further decomposing the lowest resolu- 
tion image formed in (b) into a plurality of 
lower resolution images according to the _ 50,, 
following steps: 

1. iteratively lowpass filtering and sub- 
sampling said image to create one or 
more lower resolution images; and 

2. storing said lower resolution images. 55 



method of claim 16 comprising the steps of: 

1. replicating said retrieved image to the 
dimensions of the next higher resolution lev- 
el to form a prediction image; 

2. retrieving, decrypting with a controlled 
distribution key, and decompressing the re- 
sidual image corresponding to said next 
higher resolution level; 

3. adding the decrypted, residual image de- 
compressed to said prediction image to 
form a higher resolution image for further 
use 

4. iterating these steps 1-3 for each se- 
lected key encrypted, compressed residual 
image of (b). 



17. A method for controllably reforming higher res- 
olution images encrypted according to the 



9 



BNSOOCID: <EP 0614308A1_I_> 



EP 0 614 308 A1 



DIGITAL IMAGE 



HIERARCHICAL 
DECOMPOSITION 



ENCODER 



STORAGE 
MEDIUM 



DECODER 



HIERARCHICAL 
RECOMPOSITION 



J 



HARDCOPY 

OUTPUT 
PRINTER 



I 


1 




HDTV 




NTSC 




VIDEO 




VIDEO 




DISPLAY 




DISPLAY 



SUB -NTSC 

VIDEO 
DISPLAY 



FIG. I 
(prior art) 



<JSDOCID: <EP 0614308A1 J_> 



10 



EP 0 614 308 A1 




CVJ 
CD 



I UJ 


UJ 




CD 






' 1 








ot 


CO 






i m 









Qr 
UJ 


Q 




Q 


O 




O 


O 












2 








cd 



UJ 
CO 

m 



Ul 
CD 



Uj 
CD 

1 

CO 



Uj 
CD 



CO 

UJ 

CO 



Uj 
CD 

CO 



Uj 



CO 



CD 



CO 



CO 
CO 



06l430aA1 t > 



11 



EP 0 614 308 A1 




SMSDOCIO. <EP 0614308A1_I_> 



12 



EP 0 614 308 A1 



16 BASE 

ORIGINAL 



LPF \ ^ 



I 




ENCODER 



TO 20 



42 44 

^ i-^ 

SUBSAMPLE} -* {UPSAMPLE 



I 



INTERPOLATION 
FILTER 



FIG. 4 



TO 101 



BASE IMAGE 
FROM STORAGE 



52 



54 



UPSAMPLE 



I 



INTERPOLATION 
FILTER 



XV7 



■j 200 



DECODER 



FROM 30 



t 

TO 20/ 



F/6. 5 



13 



EP 0 614 308 A1 



4 



<\J 



\ 



or 
Uj 

CD 




or 

UJ 

QQ 



Q 

I 



o 



it 

CD 

>- 
UJ 



or 
o 

S 



2 O — J 
SUjS 

U_ O Co f— 

xujtcQ 



T 



CO 



CD 



^ Ui 
co Uj 



T 



ZD 



cvj 




CL 



3 



ct 

Uj 
co 



3NSOOCIO <EP 0614308A1_I_> 



14 



J 



kuropcan Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 94 10 2910 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



O-ASSIFICATION OF THE 
APPLICATION (lntXLS) 



Y 

A 

Y 
A 

D,A 



FR-A-2 647 289 (ELECTRONIQUE SERGE 
DASSAULT) 

* abstract; claim 1; figure 1 * 

EP-A-0 392 753 (CANON) 

* abstract; figures 1-3,8 * 



US-A-4 969 204 (MELNYCHUCK ET AL.) 
* abstract; figures 1-23 * 



The present search report has been drawn up for ail claims 



1.2 

3-16 

I, 2 

3,5-9, 

II, 14,16 

1-16 



H04N1/44 



TECHNICAL FIELDS 
SEARCHED flM.Cl.S) 



H04N 



S 
2 



THE HAGUE 



P*««rf iiflinii *lt*tmmx* 

16 June 1994 



Kassow, H 



at 
O 

o 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken aJone 

Y : particularly relevant if combined with another 

document of the sai 
A : technological background 
O : iwm- writ ten disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
F. : earlier patent document, but published on, or 

after the filing date 
D : document dted in the application 
L : document dted for other reasons 

& : member of the same patent family, corresponding 
document 



BNSOCC1D: <EP 0614308A1_I_> 



THIS PAGE BLANK 



